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ABSTRACT 

A content analysis was completed of the Houghton Mifflin mathematics 
series for elementary grades. The purpose of the analysis was to pro- 
v.ide a profile of instructional activities related to content and refer- 
enced to specified instructional outcjome areas. Emphasis was placed on 
determination of: \ 

1. major outcomes in the program and their relative emphasis in 
both regular and supplementary instructional materials. 



2. the distribution of content within ^nd across instructional 
units (chapters). j * . 

3. points in the instructional sequence where mastery of outcomes 
is assessed. ' ^ . " ^ 

4. the amount of independent practice in regular and supplementary 
instructional materials /related directly to each major outcome 
developed in the progradi. 

the Qompleted-analysis forms the basis for preliminary specifica- 
tion of an application of Learning Mastery System procedures to the 
series. , / 
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CONTENT AN^YSIS OF HOUGilTON ^^IFFLI1^ MATHEMATICS PROGRAM H)R^ ELEMENTARY 
GRADES K-6 

Aaron Buchanan, Elij^ Babikiait, Jim Winchester' and Sylvia Auton 

' / ' ■ ■ 

IMS document describes a content analysis of the Houghton , Mifflin' 
mathematics series for elementary grades. Ihe document is divided into, 
three sections as follows: 

Description of the Analysis . Procedures used by staff members of 
the Southwest Regional Laboratory ^ for 'Educational Research and Develop- 
ment (SWRL) in performing the analysis are described. These procedures 
wer^*used to generate descriptors .of instructional outcomes from index 
entries in the Houghton Mifflin teacher's editions and to determine the 
location of instructional and evaluation activities relevant to these 
outcomes in various Houghton Mifflin components. 

Interpretation of the Analysis . Procedures are recommended for ^ 
identifying relationships in the analysis table between content organi- 
zation, -evaluation of outcomes, and provisions for individual practice, 
and for comparing these relationships with those desired in an applica- 
tion of a Learning Mastery System. 

Preliminary Specifications of a Learning Mastery . System Application. 
Broad preliminary specifications for the architecture of an applica- 
tion of a Learning Mastery System tp the Houghton Mifflin series are 
presented. These .speaifications include:' (1) a discrete number of 
Broad instructional outcomes that can serve as a unifying structure 
for assessing pupil progress through various levels of the program, 
(2) suggested evaluation components, and (3) materials suitable for 
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individual practice on outcomes asgessed in LMS throughout the program. 

^DESCRIPTION OF THE ANALYSIS 

CONTENT STRANDS 

1 

The analysis is Organized around twelve vertical strands of content 
identified by Houghton Mifflin as basic units of a program structure. 
Baese strands* are listed below in the order of their appearance in the 
program scope and sequence chart in each teacher's edition. Five sub- 
strands (designated by an asterisk) have been added by SWRL to facili- 
tate the classification of instructional activities. 
Numbers and ninnerals 



Numbers 

Numerals / ^ " ^ 

The numbgp^^numeral distinctioti 

Ordering 

The number line 

Concrete^ models for numbers and minerals* 
Mathematical operations " 
Properties 

Development ^of addition-subtraction with whole 
numbers 

Addition and subtraction algorisms 
Multiplication^ and division algorisms 
Operations with fractional numbers 
Operations with integers 
Extensions 

Sets 

Recognition 
Operation 

Problem solving 

Mathematical operations* 
Mathematical concepts* 
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Number sentences 
Application of mathematics 
Measurement 
Geometry 

ilonmetric* / 
. Metric* ^ ' 

Logical thinking 
Functions and graphs 
Probability and statistics 
Number theory 

r OUTCOME DESCRIPTORS 

For each strand and substrandj^ a "set of outcome descriptors has 
been prepared by SWRL staff to describe the content at each level of 
the program. These descriptors are^ statements of expected outcomes of 
^instruction. An example of descriptors for the ''Numerals" substrand of 
"Numbers and Numerals" in Level 2 is shown below. 

1. Read numerals for whole numbers to 999 

"Compact form. 
^ Expanded' form 

* 

2. Write numerals for whole nxnnbers 

3. ^Recognize numerals for fractional numbers 

Words C'half^ etc.) 

a/b form * 

4. State the place value of a digit 
To tefns 

To hundreds , . ' 

Outcome descriptors were derived using the following^pr-ocedures :. 

1. All entries in the index of the ^teacher ' s edition were par- 
titioned according to opntent strands an^substrands listed in the 
scope and sequ»tce chart. Since scope>and sequence entries over- 
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lapped considerably between some strands, elementary priorities in 
classification were followed which eliminated most of the multiple list- 
ing of index entries, 

2. Within each strand, index entries were translated into a small 
set of statements of intended mathematical behaviors (outcome descrip- 
tors). In some instances, the descriptors are comprehensive and no 
subordinate outcomes are included; in other instances, subordinate 
outcomes are included because major portions of the instructional 
materials were devoted to their review. 

.TABLE ENTRIES 

Instructional activities. (designated lessons) from the core com- ' 
ponents'of the Houghton Mifflin program were classified according to 
the prespecified outcome descriptors. Hie core components used were the 
student text (teacher's edition), the student workbook, and a separate 
battery of diagnostic tests. Since the purpose of the analysis was to 
obtain a profile of instructional activities, an exhaustive listing of 
all activities included in all components was not necessary. Programmed 
PraQtice and in-book chapter tests were not included because they were 
parallel in structure and function to the student workbook and diagnos- 
tic tests. Placement Tests were not included because the points at 
which they intervened in the instructional sequence were not closely 
related to the existing system of units in the regular program. A 
description of all. supplementary program components is in Appendix A. 

Entries in the table are page numbers in the student text, work- 
book, and diagnostic test batteries where instructional activities 
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pertinent to the outcome descriptor are located. For each entry, the 
number of items or problems directly related to the outcome descriptor 
was determined. It was reasoned that item frequencies directly related 
to an outcome descriptor are better indicators of the amount of inde- 
pendent practice provided in a chapter for each outcome than are page 
entries. In determining item frequencies, the number, ten, was chosen 
as a cutoff point since most instructional activities related princi- 
pally to major outcomes contained at least ten items of practice. An 
entry of (10) following a set of page entries indicates that ten or 
more items providing direct practice on the outcome were found in the 
chapter. 

During the course of the analysis, it became necessary to develop 
conventions fo;r determining item frequencies. Items were counted 
according to the number of separate responses requiring direct outcome- 
related performances. In some instances, such as the reproduction of 
counting sequences, individual responses were not independent of each 
other. In this case, each separate sequence was counted as a response. 
In many instances, mastery of a particular outcome, such as recognition c 
commutativity of addition, would be helpful in making a response, but 
unnecessary. Where responses could be made as a result of acquisition 
of some other outcome, especially an outcome that is learned rather 
early in the instructional sequence (such as recognition of number 
facts), no ,i terns were recorded with the descriptor. Conventions were • 
also developed for classifying problems in activities involving either 
number line or semi-concrete pictorial models to solve equations. 
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While use of the model might be helpful in making a required response, 
it was seldom required that the model be interpreted; a recall of basic 
number facts or the application of some computation algorithm was 
usually sufficient. In instances such as these, an item was recorded for 
purposes of the analysis with a descriptor involving '^models" if there' 
were separate representations of the model for each equation. 

Actual entries for a particular descriptor are coded as follows: 

1, Pages from the student text (or student pages from the 
teacher's edition) appear in regular typeface with the number of items, 
to 10, following in parentheses. 

2. Pages from the student workbook and the number of related 
items, to 10, are underlined. 

, 3. Diagnostic test entries are preceded by DT with the number of 
the test and the number of items related to the descriptor following. 

INTERPRETATION OF THE ANALYSIS 

CONTENT STRANDS 

The distribution of content in the program can be inferred from 
the analysis in the following ways: 

1. Examination of Instruction and Evaluation Entries for a 

Particular Outcome Across Chapters and Levels . It is possible to draw 

some conclusions concerning the independence of one outcome from another • 

If there are several instructional entries, but few review or evaluation 

entries, it is possible to infer that this outcome cannot be easily 

separated from other outcomes during instruction. This inference is re- 

\ 



lated to methods used in development of the analysis. The major 'source 
of instruction entries (textbook) was the index^Sf teacher's editions 
at each level. Since index entries are likely to be classified with 
as many content domains as are possibly relevant, there was a con- 
siderable degree of multiple classification ainong instructional entries. 
Review and evaluation entries, on the other hand, were made from a 
page-by-page analysis of the components. In this "Sase, multiple 
classification was avoided wherever possible, and activities were 
referenced to the outcome with the most appropriate descriptor. For 
example, '^number recognition" is implicit in "numeral recognition". 
Among instruction entries, activities are classified under outcomes 
related to both skills. However, most evaluation activities do not 
discriminate between the two ^skills and, in the analysis, would all 
be classified under outcomes related to "numeral recognition". Examples 
of discrepancies between instruction and evaluation entries under the 
"Number" substrand of "Numbers aijjp^umerals" appear in Grade 1. In 
this- substrand, there are apprbximately 18 review items and no diagnos- 
tic test items dealing independently with content found on over 40 
pages of instructional activities. Other examples occur in the 
"Properties'* substrand of "Sets" in Grade 1 where there is only one 
diagnostic test entry for the entire level. It would be unlikely 
that strands such as these would be preserved independently in a 
Learning Mastery System, or at least they would not be identified 
until mastery of related outcomes could be discriminated clearly from 
outcomes in other strands. 
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2, Examination of Entries in the Chapter Colunms ^ For purposes 
of a Learning Mastery System it is desirable that content included in 
each chapter be reasonably homogeneous. Unit division should be de- 
termined primarily by outcomes to be acquired and their presentation 
sequence. The instructional entries in each chapter should be spread' 
over no more than 7 or 8 outcomes if evaluation of mastery is to 
retain some reliability and tests are to remain a reasonable length. 
Where chapters in Houghton Mifflin provide instruction on more outcomes 
than this, it may be necessary to defer assessment of some outcomes 
until they are represented in a subsequent chapter. 

3m Examination of all Descriptors for a Particular Content Strand 
over all Levels of the Program , If there are very few descriptors 
that differ distinctly, or if the set of descriptors shW little 
hierarchical relationship, the strand probably does not possess 

strong sequential characteristics of its own. ^: Frequently , as in 

1 . ^ 

"Applications of Mathematics", the strand exists primarily for the in- 
elusion of activities where mathematical skill^j are applied ta verbal 
or pictorial problems. Some strands, such as "jSfets" in Levels K-3, 
exist principally as a model for whole numbers and related operations. 
By comparison, material devoted directly to the development of con- 
cepts related to sets and set theory is relatively minor. 

OUTCOME ASSESSMENT 

Instructional entries frequently occur in the analysis with no 
accompanying evaluation entries. In general, this circifmstance im- 
plies one o$ the following: 



If) 



ERIC 



!• Evaluation is deficient;/ 

2r Instruction is primarily in the form of teacher explanation 
with little or no, independent practice for the pupil, 

3, Instruction and practice on a particular outcome cannot be 
separated from a more inclusive outcome. 

4, Hie outcome is minor in comparison to the amount of instruc- 
tion given on other skills presented in the unit. 

Occasionally, an outcome will be assessed at a lower level than 
that reached during regular instruction, Hiis cond4.tion sometimes 
occurs when the amount of instruction on the skill at the higiher level 
is either very small, or is intended as an extension of an outcome for 

\ 

y more able pupils, ^ ^ 

Th^ number of items per skill-per unit averages 3-4 for major 
skills and 1-3 for m£nor skills, iltem frequencies such as these may 
be adequate in skill maintenance or retention, but should probably be 
'increased in criterion exercises where acquisition of new or extended 
skills is assessed, 

INDEPENDENT PRACTICE 

The amount of independent^ practice on each outcome can be de- 
termined by attending ta the numbers -iji .parentheses following under- J 
lined and non-underlined page entries. Of primary interest are 
instances where instructional entries (regular instruction and review) 
are associated with fewer than ten items of independent practice. 
The number ten was chosen as a reference point for the analysis since 
many activities approached but did not exceed this number. It was 
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reasoned that outcomes with fewer than ten items of practice, and 
particularly outcomes with fewer* than five or six items, do ^t pro- 
vide sufficient practice for attainment of the skill • 

PRELIMINARY SPECIFICATIONS .OF A LEARNING MASTERY SYSTEM APPLICATION 
CONTENT STRANDS 

The strands of content related to the arithmetic of whole and 
rational numbers are dominant. This may be inferred by inspecting the 
number of outcomes developed (as represented by outcome descriptors) 
and the number of instructional entries per outcome. Outcomes develop 
ed in these strands, as well as most of their substrands, usually in- 
clude at least 10 items of independent practice* Strands such as 
"Applications of Mathematics" and, at earlier levels, "Number Theory", 
contain so many outcome descriptors in common with other strands 
that it is doubtful that preserving them as independent outcome areas • 
in a Learning Mastery System would be worthwhile, 

INSTRUCTIONAL OUTCOMES 

Five or six broad outcomes such as the following likely will be 
recommended as a basic outcome structure for the development of 
Learning Mastery System procedures: 

1, Recognize basic elements and concepts 

2, Decode systems of symbols 

3» Express mathematical relationships 

4, Verify mathematical relationships • . * 
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5. Perform^ operations 

6. Solve verbal problems 

One or more of tK^se outcomes represent major skills to be develop 
ed-in each of content domains such as the following: 

I*. Sets • ' ^ ' 

II ♦ Whole numbers 
III. Rational numbers (positive) 
IV. Integers ^ 

* V. Geometry ^.^^/^ 

* VI. Measurement 
VII. I^gic 

j^pil process through broad instructional sequences far outcomes 
applicable to^each content domain will be monitored throughout the 
program. At each level, a set of outcome descriptors, will farther * 
refine cells in the outcome-content matrix to reflect all of the , ^ 
content included in the program for that level. 

EVALUATION COMPONENTS 

In a number of instances .recognition of properties of mathemati- 
cal operations is introduced through verbal instructions given by the 
teacher. Pupils are encouraged bu|: not require^ to. recognize these 
properties in solving related equations or problems. Acquisition of 
skills such as these' should not be[ assessed In a Learning Mastery 
System until approximately 10 items of independent practice have been 
provided in a single chapter. 




Several chapters contain instiructional entries classified under 
.outcome .descriptors which are peripheral to major skills under 
development. For example, interpretation of secret codes may be used 
as a setting for evaluating the acquisition of number facts', but it 
should not be considered as an independent outcome to be developed in 
a major instructional sequence. The major focus in chapters such as 
^^titiese will be assessment of outcomes introduced and any of their 
prerequisites which are reviewed. In chapters where no instruction on 
new outcomes is begun, the principal outcomes under review will be 
evaluated. The context for evaluation should include settings which 
parallel those used during regular instruction, but they should also ^ 
include some transfer settings which may be generally familiar to the 
pupil but not in association with the outcome under devefopmejit . In 
* general, there should noj|| be more than two or three items of the 
latter type for any particular outcome developed in a chapter. 

LMS evaluation components for Houghton Mifflin should include 
the following: * / 

1. Four to Six Pretests, for Each Level . The nimiber of pretests 
will be determined by the number of major breaks in the continuity of 
the instructional sequence. It will nottbe necessary to develop a 
pretest for each chapter, since many follow directly from the previous 
' ^chapter. Essentially, all of the information which might be of value 
to Jhe teacher can be obtained from posttest or criterion exercise 
instruments for the previous unit. Pretests should provide a compre- 
hensive sample of behaviors that are prerequisite to the major 



ERIC 



14 



13 



skills developed in the chapter. The information obtained from the 
pretest should guide the teacher in determining the relative 

«tophasis to be given any prerequisite behaviors which are reviewed 

/• _ 

^riot to the introduction of new material, SWRL-developed pretests 
are recommended over Houghton Mifflin Placement Tests since the 
latter are not compatible with the unit structure in the regular 
instructional program. 

2. En**toute Assessment Devices for Each Major Outcome Introduced 
or Reviewed , A limited number of problems in the regular daily 
assignment will be identified which the teacher can review as a check 
on the progress of the pupil toward mastery of the outcome. 

3. End»of''Uhit Criterion Exercise for Each Unit. Each exercise - 

should include at least one section for each of the major out- 

comes on which instruction was provided in that unit. Approximately 

♦ 

4-5 items should be included for each individual outcome representing 
material which has been introduced or extended. One or two items 
should be included for each descriptor where previously mastered 
skills have been reviewed 'or maintained. 

Each exercise should include a limited number of problems Vhere 
computational skills which have been developed are applied to the 
solution of verbal problems. The format for all *items on the 
criterion exercise should be multiple choice with atJ^st some of the 

r 

'4 

distractors representing typical errors which might be made on this* 
type of problem. 
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SWRL-developed instniments are** recommended over existing Houghton 
Mifflin Diagnostic Tests £pr the following reasons: 

, (1) Houghton Mifflin Dia^ostic Te6tjs are not clearly organized 
around instructional outcome^. v ^ ' 

(2) At times, Houghton Mifflin outc<ime§ are tested at a slightly 
lower level than that reached during regular instruction. 

(3) Many outcome-areas are evaluated with f ewer 4 items per 
instrument. . . 

(4) Ihe constructed response format used with items is incompatibl 
with machine scoring and remedial practice based on typical errors. 

PRACTICE COMPONENTS ' 

Appropriate practice materials should be developed as part of 
the LMS. Wherever possible, supplementary practice should be pro- 
vijded in such a way that the teacher can select exercises on the 
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basis of major types of errors committed. 

/ 

SUPPORT COMPONENTS 

. Various support components, including a technical manual and 
appropriate record keeping materials will also be provided. 
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APPENDIX A 



DESCRIPTION OF' HOUSTON MIFFLIN COMPONENTS j 

Houghton Mifflin has designed the set of student's t«^s and 
accompanying teacher's editions to serve as the core of fho, mathe** 
tnatics program, A number of additional components, designated by the 
publishers as supplementary, are available as follows: 

(1) Diagnostic tests« »A battery of 28 diagnostic tests, averaging 
19-20 items per test, is provided for each of Levels 1-6. Tvo or three 
diagnostic tegts are provided for each chapter to be used after some 
designated page. Four t'o five of the tests are cumulative and include 
material from several^ chapters. Items on all of the tests are parallel 
to ppBfblems provided for practice dxxring regular instruction. ^^ 
^eirtions of each non-cuifiulative test are referenxsed to particular * , 
pages in^ the student's text. The teacher's editiofn identifies specific 
points in each chapter at which diagnostic tests are to be given^ 

(2) Duplicating Masters- A set of duplicating masters is pro- 
vided for each of Levels 1-6. Approximately 60 masters are provided 
for Levels 1 and 2, and 80 masters for eaeh of Levels 3-6. These 
masters contain 15-20 problems which are parallel tp problems in- 
cluded in the student's text. Subsets of problems are keyed to 
specific pages of the text, while joints where duplicating masters 
are to be g%yfBn are designated in the teacher* s edition. 



(3) Workbook-A workbook for each of Levels 1-6 provides approx- 
imately 95 pages of practice problems parallel to material in the 
student's text. Each practice page is designated for use after a 
specific page in the student's text, Re^ferences are included on, both 
practice pages and corresponding pages in the teacher's edition. . 

(4) Prograinmed practice -'A programmed practice book is provided 
for each of Levels 3-6. Ihis book includes one page of self -directed 
exercises with answers for each lesson (two pages) in the student's 
text. 'Rie exercises contain problems which parallel problems found 
on corresponding pages in the student's text. Self administered 
chapter tests contain items which are parallel to those found in the . 
in-book chapter tests. 

(5) Placement Tests -A battery of tests designed for use prior to 
instruction at each level is provided. These tests sample problems 
from the entire level and are designed chiefly for identifying pupil 
strengths and weaknesses relative to placement in a non-graded pro- 
gram. Ihe publisher suggests that they could also be used as end-of- 
year postteSts for each level. 

(i) Manipulative Aide -Ihese materials include colored centimeter 
rods, abacus, geometric shapes, number line, and centimeter grid 
paper. A separate teacher's guide is available. 

'(7) , Geob oar d , Ki t -Thi s includes a geoboatd, Rubber bands, and a 
set of 40 activity cards., 

(8) Teaching-Learning Kit ^This includes a 28" x 24"^ adhesive 
board and 376 display pieces. (Teacher's guide is included.) 
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. (9) Concept and Skill Cards -^These include 14 kits of cards 
suitable for class or individual use in providing extra practiced 

(10) Readiness books -There is one readiness book for each of 
Levels 3-6. Each book includes a review of key concepts developed in 
the previous level • 

(11) Overhead Visual s -A set of visuals had been developed for 
Levels 1-6 to accompany instruction on certain concepts.' Approximately 
25 visuals are provided for e^ch level. 

(12) Ncmgraded Program-A booklet is provided for adapting the 
regular Houghton Mifflin jprogram to a non-graded setting. 
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